Configuration of synchronisation network

ABSTRACT

Configuring a node (410, A-I, L-O) of a synchronization network, involves determining information about synchronization sources of a plurality of synchronization trails for passing synchronization information from the synchronization source (A, L, O, PRC) to the node to provide a synchronization reference. After determining automatically (210, 230, 330, 335, 340) synchonization transmission characteristics of trails (EF, FG, GH, HM, MN, OF, FI, IH) which use packet-based communication, the trails are compared automatically (240, 370), using their source information and their synchronization transmission characteristics, for selecting which of these trails to use for providing the synchronization reference for the node (N). Compared to selections made based on source alone, using the synchronization transmission characteristics of the packet based parts can enable a better choice of trail, and can enable comparison with synchronous type trails, and so enable hybrid synchronization networks to be configured and maintained.

PRIORITY

This application is a continuation, under 35 U.S.C. § 120, of U.S.patent application Ser. No. 13/508,406 which is a U.S. National StageFiling under 35 U.S.C. § 371 of International Patent Application SerialNo. PCT/EP2010/50526, filed Jan. 18, 2010, and entitled “ConfigurationOf Synchronisation Network” which claims priority to European PatentApplication No. 09176539.6 filed Nov. 19, 2009, both of which are herebyincorporated by reference in their entirety.

FIELD OF THE INVENTION

This invention relates to methods of configuring nodes of asynchronization network, to nodes for such networks, to managementsystems for such networks, to synchronization networks, to correspondingcomputer programs and to databases for use in configuration of suchnetworks.

BACKGROUND

There are many types of communications networks, for conveyinginformation between remote points. For example wide area networksbelonging to telecommunications providers, internet service providers,company intranets, cable television distribution systems and other datacommunication networks can use optical networks in which digitalinformation is conveyed in the form of optical signals through opticalfibers. Digital information in communication networks can be categorisedas asynchronous or synchronous types. Synchronous types such as SDH(Synchronous Digital Hierarchy) require a common timing reference tooperate accurately. That is, the clocks in one node of the networkshould operate at the same speed as the clocks in other nodes of thenetwork.

To provide for a common timing reference, communication networkscarrying digital information can include synchronization networks, whosejob it is to ensure that a common timing reference is used throughoutthe communications network. One such synchronization network isdescribed in European. Telecommunication Standards Institute (ETSI)document European Guide (EG) 201 793 v1.1.1 (2000-10), entitled“Transmission and Multiplexing (TM); Synchronization NetworkEngineering”. This document describes the various elements that make upa synchronization network, and the principles of operation by which sucha network distributes accurate timing information from so-called PrimaryReference Clocks (PRCs) to the clocks located in other pieces ofequipment throughout the network. PRCs are the highest quality clocks ina network, and are usually based on a free-running Caesium Beamoscillator giving a very accurate clock performance.

Poor network synchronization usually leads to large amounts of jitterand wander, and, consequently, to transmission errors and bufferunder/overflow. Both these faults will result in service problemscausing high error rates and service unavailability. In the best case,then, poor synchronization causes only few inconveniences to any othernetwork layer; in the worst case, it can make the entiretelecommunication network stop passing traffic. A well-planned andmaintained synchronization network is then a prerequisite for avoidingor reducing a risk of critical failures in traffic networks.

The planning of a synchronization network is typically performedmanually, according to some rules as defined in relevant ITU-Trecommendations (e.g., ITU-T G.803) and other relevant standards (e.g.the above mentioned ETSI EG 201 793). Some computer-aided tools mayassist the synchronization network planning and maintenance by, forinstance, supporting the off-line design of the reference tuning signalsdistribution, as well as providing simulations of the synchronizationnetwork normal operation and fault scenarios.

The management of a live synchronization network, on the other hand, isusually distributed over a number of platforms, as the types of theequipment participating into the synchronization network can bedifferent. Therefore separate network management systems have tocoexist, each taking care of a network type, e.g., synchronizationdedicated, switching, transmission, and so forth. These managementsystems usually only provide the means to monitor the synchronizationnetwork and detect possible failures; in the latter case the singlenodes will rearrange according to their synchronization set-up, or itwill be up to the operator to perform recovery actions.

In case of a physical layer based synchronization network, thesynchronization network is typically non-dedicated, meaning it issuperimposed on the communications network and the transport layer ofthis network is the carrier of the reference timing signal. Due to that,although this is the most commonly used method, some issues may arise:this type of network is generally complicated to plan, difficult tooperate, might be dependent on other operators and on the type ofcommunications network it is superimposed on.

Accurate planning of non-dedicated synchronization networks is generallya complicated task. Even if this is done perfectly in the initialplanning, it requires significant effort in the re-planning of thesynchronization network every time other network types/layers arechanged.

Additional issues may arise when deploying new and heterogeneoustechnologies. For instance, synchronization networks can be hybridnetworks made up of trails having some parts using synchronouscommunications and other parts using packet-based communications. Forexample, nodes supporting either TDM legacy (e.g., PDH, SDH), orsynchronous Ethernet, can be mixed with those using packet basedtechnologies to transfer the synchronization information. Thesynchronization network management, in this case, appears extremelychallenging and may significantly increase the OPEX (operationalexpenditure) for an operator.

It is known from the Precision Time protocol (PTP) (IEEE standard1588-2008 Standard for a Precision Clock Synchronization Protocol forNetworked Measurement and Control Systems) to send timing informationover packet networks, so that carrier Ethernet networks, for example,can carry telecom quality clocks to network nodes. This standard definesa structured time stamp based on the output of a master clock at a timeof transmission of the timing packet, and an Ethernet or IP packetlocation for it. PTP uses a two way transfer technique to enablefrequency, time and phase alignment to be generated by slave nodes. Itdefines master nodes, boundary nodes and transparent nodes. The packetscan be passed by any Ethernet nodes and be treated as regular datapackets.

SUMMARY

An object of the invention is to provide an improved apparatus or methodfor configuring a synchronization network. According to a first aspect,the invention provides:

A method of configuring a node of a synchronization network, the methodcomprising the steps of: a) determining information aboutsynchronization sources of a plurality of synchronization trails forpassing synchronization information from the synchronization source tothe node to provide a synchronization reference, a part of at least oneof the trails using packet-based communication to pass thesynchronization information, b) determining automaticallysynchronization transmission characteristics of the part which uses thepacket-based communication, and c) comparing automatically the trailsleading to the node, using the determined source information and usingthe determined synchronization transmission characteristics, forselecting which of these trails and related synchronization source touse for providing the synchronization reference for the node (N).

Compared to selections made based on source alone, by determining andusing the synchronization transmission characteristics of the packetbased parts, a better choice of trail can be made, and the trails can becompared more readily with trails not using packet-based communication.This is particularly useful for networks such as hybrid synchronizationnetworks having different types of trails, with parts which arepacket-based and parts which are synchronous, such as those based onphysical layer links. It can help enable such hybrid networks to beconfigured and maintained automatically in a more unified or integratedmanner. This can reduce the amount of time and money spent managing andmaintaining such hybrid synchronization networks. This is particularlyuseful where communication networks are more complex mixtures of legacyTDM and packet based technologies, and have more widely distributedsynchronization sources, making their synchronization networks morecomplex.

Any additional features can be added to those discussed above, and someare described in more detail below.

Another aspect of the invention can involve a node for a synchronizationnetwork, the node having: a) a trail information manager arranged todetermine information about sources of a plurality of synchronizationtrails which lead to the node, for passing synchronization informationfrom the synchronization sources to the node, to provide asynchronization reference, a part of at least one of the trails usingpacket-based communication to pass the synchronization information, thetrail manager also being arranged to determine automaticallysynchronization transmission characteristics of the part which uses thepacket-based communication, and b) a comparator arranged to compare thetrails leading to the node using the synchronization transmissioncharacteristics, for selecting which of the trails to use for providingthe synchronization reference for the node. Any additional features canbe added. Another aspect provides a management system for asynchronization network, the management system being arranged to carryout the method of configuring as set out above. Such centralisedconfiguring can avoid delays in propagating changes across a largenetwork, and make it easier for an operator to monitor or intervene)

Another aspect provides a synchronization network having a number ofnodes, and having a number of synchronization trails for passingsynchronization information from a synchronization source to the nodesof the hybrid synchronization network, the hybrid synchronizationnetwork having a management system arranged to carry out the method ofconfiguring as set out above.

Another aspect provides a computer program stored on a computer readablemedium and comprising instructions executable by a processor to causethe processor to carry out the method of configuring as set out above.

Another aspect provides a database for configuration of a node of asynchronization network, the database comprising a record ofsynchronization sources of a plurality of synchronization trails forpassing synchronization information from the synchronization sources tothe node, to provide a synchronization reference, a part of at least oneof the trails using packet-based communication, and the database alsocomprising a record of synchronization transmission characteristics ofthe part using packet-based communication, and a record of which of thetrails has been selected to provide the synchronization reference.

Any of the additional features can be combined together and combinedwith any of the aspects. Other advantages will be apparent to thoseskilled in the art, especially over other prior art. Numerous variationsand modifications can be made without departing from the claims of thepresent invention. Therefore, it should be clearly understood that theform of the present invention is illustrative only and is not intendedto limit the scope of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS

How the present invention may be put into effect will now be describedby way of example with reference to the appended drawings, in which:

FIG. 1 shows a schematic view of a synchronization network,

FIG. 2 shows a schematic view of a node of a synchronization networkaccording to an embodiment,

FIG. 3 shows some steps in configuring a synchronization networkaccording to an embodiment,

FIG. 4 shows a database table of source and transmission characteristicsfor trails, according to an embodiment,

FIGS. 5 to 9 show steps in configuring a synchronization networkaccording to embodiments,

FIG. 10 shows a schematic view of a node of a synchronization network,and a centralized synchronization management system according to anembodiment,

FIG. 11 shows a schematic view of a synchronization network, showing twoexample trails to node N,

FIGS. 12 and 13 show examples of sync-specification Sub-TLVs, and

FIG. 14 shows a schematic view of a communications network andsynchronization network.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

The present invention will be described with respect to particularembodiments and with reference to certain drawings but the invention isnot limited thereto but only by the claims. The drawings described areonly schematic and are non-limiting. In the drawings, the size of someof the elements may be exaggerated and not drawn on scale forillustrative purposes.

Definitions

Where the term “comprising” is used in the present description andclaims, it does not exclude other elements or steps. Where an indefiniteor definite article is used when referring to a singular noun e.g. “a”or “an”, “the”, this includes a plural of that noun unless somethingelse is specifically stated.

The term “comprising”, used in the claims, should not be interpreted asbeing restricted to the means listed thereafter; it does not excludeother elements or steps.

Elements or parts of the described nodes or networks may comprise logicencoded in media for performing any kind of information processing.Logic may comprise software encoded in a disk or other computer-readablemedium and/or instructions encoded in an application specific integratedcircuit (ASIC), field programmable gate array (FPGA), or other processoror hardware.

References to switching nodes can encompass any kind of switching node,not limited to the types described,

References to software can encompass any type of programs in anylanguage executable directly or indirectly on processing hardware.

References to hardware, processing hardware or circuitry can encompassany kind of logic or analog circuitry, integrated to any degree, and notlimited to general purpose processors, digital signal processors, ASICs,FPGAs, discrete components or logic and so on.

References to trails can encompass any indication or description of apath followed by synchronization information, such as a list of nodes,or a list of links between nodes, or list of locations or directions tobe followed, or an algorithm for calculating such lists or directions,or any other similar indication or description.

References to nodes of a network can encompass any kind of identifiablelocation in the network having any function such as routing or switchingor multiplexing or demultiplexing or for supporting various transporttechnologies such as OTN, SDH, or any other kind of processing ofinformation passed across the network, not limited to any level ofintegration, or size or bandwidth or bit rate and so on.

References to packet-based can encompass any kind of packet having anykind of header, or framing, and can be transmitted asynchronously, ortransmitted over a synchronous link. In context of sync, such packetsmay have timestamp in header or payload for example. Examples are NTPpackets or PTP packets as defined by RFC 1305, and many other types canbe envisaged.

References to hybrid synchronization networks can encompass networks inwhich timing information (frequency or phase for example) is carried insome parts by the physical layer and in other parts carried bypacket-based communication, as opposed to networks which do not usepackets, or networks in which all information is carried by packets,even if the packets are carried over a synchronous physical layer.

References to synchronization sources can encompass any source of timingin a synchronization trail and can encompass PRCs for frequency, andprimary reference time clocks PRTCs for phase information for example.These can be implemented by GPS (global positioning system), or atomicclocks for example.

These definitions can be extended where appropriate to encompassdefinitions of similar parts in standards such as the well known G.810.

References to synchronization transmission characteristics can encompassany kind of characteristics which have an effect on the transmission ofthe synchronization information, such as number of nodes passed, speedof links used, status of parts or links used, quality characteristicssuch as packet delay variation, nodes which regenerate thesynchronization information, nodes which enhance the synchronizationinformation, for example by making measurements en route.

Abbreviations

ASON Automatically Switched Optical Network

BMC Best Master Clock

ESMC Ethernet Synchronization Messaging Channel

LC Link Component

LMP Link Management Protocol

LSA Link-State Advertisement

MPLS Multi-Protocol Label Switching

OPS On-Path Support

OSPF Open Shortest Path First

PDV Packet Delay variation

PTP Precise Time Protocol

QoS Quality of Service

SSM Synchronization Status Message

SyncE Synchronous Ethernet

TE Traffic Engineering

TLV Type-Length-Value

WSON Wavelength Switched Optical Network

As a preliminary to the description of embodiments, some issues withconventional features of synchronization networks will be explained, tofacilitate understanding of features of the embodiments and how theycomplement or contrast features of existing networks.

FIG. 14, Communication Network and Synchronization Network

FIG. 14 shows a block diagram of a digital communication network 100that includes a synchronization network. For purposes of illustration,the network 100 is a telecommunications network, and therefore includes,at network nodes, equipment that is well-known in the art. In thefigure, transport links are indicated by solid lines, andsynchronization trails for carrying synchronization information (thetrails being made up of a sequence of reference links) are shown bydashed lines that include an arrow at one end to indicate the source andrecipient of the synchronization information such as a reference clocksignal. Where a node has the possibility of receiving a reference clockfrom more than one source, primary reference links (i.e., thosesynchronization links that are preferred to be used for supplying areference clock from one node to another) are denoted by the number “1”next to the dashed line indicating the link. Secondary reference links(i.e., those synchronization links that are used when the primarysynchronization link is unavailable) are denoted by the number “2” nextto the dashed line indicating the link.

Where some of the reference links forming the synchronization trails arearranged to use packet based protocols, the synchronization network isknown as a hybrid synchronization network. Such packet based protocolsmay be carried over synchronous physical layer links of the underlyingtransport network as shown in FIG. 14. An example showing more detailsof which links use packet-based protocols is set out in FIG. 1.

The network 100 utilizes the Synchronous Digital Hierarchy (SDH), whichis a standard technology for synchronous data transmission on opticalmedia. It is the international equivalent of the Synchronous OpticalNetwork (SONET). To facilitate the following discussion, the variousnodes of the network are given reference characters A, B, C, D, E, F, G,H, I, L, M, and N.

In a fully synchronized network, all sources should be ultimatelytraceable to a PRC. In the exemplary network, this is the PRC A. The PRCA supplies its high quality clocking signal (“clock”) to node B whichcan be for example Stand Alone Synchronization Equipment (SASE) B. ASASE is a piece of synchronization equipment that contains aSynchronization Supply Unit (SSU), which is a high quality slave clock.The SASE B distributes its clock signal to node C which can be forexample a Digital Exchange (or, in alternative embodiments, could be aTelephone Exchange). Node B can also feed node D, which can be forexample an SDH multiplexer (MUX) D.

The SDH MUX D distributes its clock signal to an SDH Digital CrossConnect unit (SDH DXC) E, which in turn distributes its clock signal toan SDH Add Drop Multiplexer (ADM) F. The clock supplied by the SDH ADM Fis then supplied to each of two more SDH ADMs G and I. The referencelink between the SDH ADM F and the SDH ADM G is a primary link.

Rather than using the supplied clock signal itself, the SDH ADM Ioperates in a “bypass” mode (commonly named “NON-SETS locked”, where“SETS” stands for “Synchronous Equipment Timing Source”), whereby thesynchronization clock is merely forwarded directly to the SASE L. Thisis common when, for example, the ADM and SASE are implemented in thesame building. Essentially, the SASE L is the real recipient of thesynchronization clock supplied by SDH ADM F, and this clock is treatedas a secondary link. The SASE L's primary link is supplied (through theSDH ADM I operating in “bypass” mode) by an SDH ADM H.

Despite its bypass function, the SDH ADM I does require asynchronization clock, and this is supplied by the SASE L.

The SDH ADM I supplies its synchronization clock to the SDH ADM H, andthis is treated as a secondary link. The SDH ADM H's primary link issupplied by the SDH ADM G. To permit reconfigurability, the SDH ADM H isalso coupled to supply a synchronization clock to the SDH ADM G, andthis is treated as a secondary link by the SDH ADM G.

The SDH ADM H also supplies a synchronization clock to a digital switchM, which also receives a synchronization clock from the digital switchN. The remainder of the network is not shown, for the sake of brevity.

FIG. 14, Timing Loops

It is very important that the synchronization network be planned in sucha way so as to avoid the occurrence of timing loops, both during normaloperation as well as when a malfunction prevents one or more nodes fromsupplying their reference clocks to their planned recipient nodes. Atiming loop is created when a clock is directly or indirectlysynchronized to itself. In a timing loop situation, all the clocksbelonging to the loop can show a large frequency offset compared tonominal frequency and are likely to be isolated from the rest of thesynchronization network. To avoid timing loops, elements in a ringshould be provided with means that enable the possible generation oftiming loops to be discovered. Such elements are usually connected suchthat they each have at least two synchronization sources, so that whenone source is discovered to cause a timing loop, there is at least thepossibility of avoiding it by selecting one of the alternative sources.For example, suppose that the reference link between nodes F and G iscut. In this situation, the SDH ADM G will respond by looking to node Hto supply the necessary reference clock. However, under normalcircumstances, node H expects to receive its reference clock from nodeG. It is apparent that a timing loop will occur here unless node H alsoresponds to the break between nodes F and G by looking to another sourcefor its reference clock. It is important that the clock supplied by thisalternative source also not ultimately be derived from the clock at nodeG or from the clock at node H in order to avoid a timing loop.

In SDH networks, the use of Synchronous Status Messages (SSMs) providessome help with avoiding timing loops. An SSM is a signal that is passedover a synchronization interface to indicate the Quality-Level of theclock that the interface is ultimately traceable to; that is, thegrade-of-clock to which it is synchronized directly or indirectly via achain of network element clocks (the “synchronization trail”), howeverlong this chain of clocks is. In a fully synchronized network, allsources should ultimately be traceable to a PRC, and there is apredefined code to indicate this. Another code, “Do Not Use forSynchronization”, is used to prevent timing loops and is transmitted inthe opposite direction on interfaces used to synchronize an equipment'sclock.

Although the SSM algorithm is a good concept in some applications likeSDH or SONET rings, it is unable to guarantee that all timing loops willbe prevented, because it only provides information about the quality ofthe traceable synchronization reference source, but not informationabout the actual physical source. Sec, for example, chapter 4.13 of ET S300 417-6-1, “Generic requirements of transport functionality ofequipment: Synchronization layer function”. Another drawback of the SSMalgorithm is that it is often not supported by SASE or by NetworkElements other than SDH/SONET Network elements (i.e., it can only beused between SDH/SONET Network Elements). It is noted that timing loopscan cause severe disturbances in the traffic network, but that theeffect of these disturbances very seldom gives a readily discernableindication of where the failure in the synchronization network occurred.It is therefore important to provide effective ways for managingsynchronization networks so that, when failures occur in the network, itcan be determined how to rearrange the network to maintain an acceptablequality of synchronization without creating timing loops.

FIG. 14, Configuration Management Issues

Current practice is for the management of synchronization networks to bedistributed among several platforms. The reason for this is that asynchronization network very often consists of different types ofequipment that can be either dedicated to synchronization (e.g., SASE),or to both synchronization and traffic (e.g., and SDH multiplexer or adigital switch). As a result, several management systems (e.g., one forthe SASE network, one for the SDH equipment, one for the switchingnetwork, etc.) have to be maintained in parallel. This situation isillustrated in FIG. 14, in which a first Switching Network ManagementNetwork 101 manages the Digital Exchange at node C; a SASE ManagementNetwork 103 manages the SASE at nodes B and L; a first SDH ManagementNetwork 105 manages the SDH Mux at node D, the SDH DXC at node E, andthe SDH ADMs at nodes F and I; a second Switching Network ManagementNetwork 107 manages the Digital Switches at nodes M and N; and a secondSDH Management Network 109 manages the SDH ADMs at nodes G and H. Thissituation is not unrealistic, since the “same” type of equipment (e.g.,an SDH ADM) may be manufactured by different vendors who design theirequipment using incompatible equipment management strategies. Some orall of the management systems may be arranged to maintain a local map ofneighbouring nodes and of different trails providing synchronizationinformation from various sources to each of their nodes. Thesemanagement systems would have to be individually configured with detailsof any changes outside their area of control.

By replacing the method of handling synchronization information at someof the nodes to use packet-based communication, the synchronizationnetwork becomes a hybrid network. A network where timing information iscarried over packets allows the distribution of phase and timeinformation as well as frequency information. Where some parts of thetrails use packet-based communication, this can add a furthercomplication to management of the configuration of the synchronizationnetwork, both at the initial planning or commissioning stage and ongoingconfiguration during the service life of the networks. This may involvecontinuous maintenance by maintenance personnel who may need to bephysically present at the numerous sites of the different nodes. In mostcases, this physical presence at each site is difficult and expensivedue to geographical distribution of the synchronization network.

Features of the Embodiments

In order to address the issues above and with the purpose of reducingthe related OPEX, one approach involves trying to add some level ofautomation into the sync network configuration process, from the initialplanning, to the reconfigurations during operation of thesynchronization network. A more drastic approach is to have the ControlPlane of the communications network handle the configuration and theoperation of the synchronization network. This is one of the features ofsome embodiments of the present invention. Other features to extend theconventional arrangements include a fully automatic synchronizationnetwork implemented by the Control Plane where in addition to a powerfulsynchronization operation (e.g., recovery after failure) thesynchronization network can be auto-configured starting from thetopology and other relevant information.

In addition the concepts can be applied to any type of synchronizationmethods, not only SDH/PDH but also new generation technologies such asIEEE1588 based synchronization networks. Furthermore some embodimentscan address time synchronization in addition to frequencysynchronization, and some embodiments can use OSPF extensions bydefinition of a TE Link LSA capable of carrying also synchronizationinformation.

Some embodiments can have distributed management of the configuration ofthe synchronization network in which all nodes involved in thesynchronization network exchange information in order to build a pictureof the synchronization network itself and its sync trails. This can beused to maintain it (e.g. select the synchronization reference accordingto predefined rules) and allow for appropriate reaction by reconfiguringwhen any topology change or network failure is detected.

This could be done either in a centralized or in a distributed manner:in the former case a network management central node takes care ofdistributing all necessary information and configuration commands. Inthe latter case each node maintains a database containing all theinformation relating to the entire network.

As will be described below in more detail, configuring a node of ahybrid synchronization network, can involve determining informationabout synchronization sources of a plurality of synchronization trailsfor passing synchronization information from the synchronization sourceto the node to provide a synchronization reference. After determiningautomatically synchronization transmission characteristics of trailswhich use packet-based communication, the trails are comparedautomatically, using their source information and their synchronizationtransmission characteristics, for selecting which of these trails to usefor providing the synchronization reference for the node. Compared toselections made based on source alone, using the synchronizationtransmission characteristics of the packet based parts can enable abetter choice of trail, and can enable comparison with synchronous typetrails, which can help enable such hybrid synchronization networks to beconfigured and maintained.

Additional features of some embodiments can include the following: thestep of determining synchronization transmission characteristics cancomprise determining information about nodes used to pass packets usedfor the packet-based communication. This characteristic is likely tohave the most influence on the quality of synchronization transmissionby packet.

The step of determining information about nodes can comprise determininginformation relating to enhancement by any node of the synchronizationinformation carried by the packets. Such enhancement can improve thequality of the trail and so can affect and improve the comparison of thetrails. The step of determining information relating to enhancement cancomprise determining information relating to regeneration of thesynchronization information at another node (F) along the trail. Suchregeneration can improve the quality of the trail and so can affect andimprove the comparison of the trails.

The enhancement can comprise information about delays to the packetscarrying the synchronization information, the delays being determined byanother node (H) along the trail. Such additional information can beused by the node to improve the quality of the reference and so this canaffect the quality of the trail and so affect and improve the comparisonof the trails.

The information about delays can comprise any one or more of: delaysinternal to a node, delays between nodes, and amounts of delayvariation. The method can have the additional step of determininginformation about synchronous parts of any trails leading to the nodeand using this information in making the comparison.

The step of determining the synchronization transmission characteristicscan be carried out by the node, and the node can have a record of thesynchronization trails to itself and to other nodes. Such distributedconfiguration management can enable more resilience to local or centralequipment failures, and easier addition of new nodes, though centralizedsolutions may be more appropriate for larger networks to avoid slowpropagation of changes.

The method can have the steps of receiving at the node an update of thesynchronization transmission characteristics from a neighbouring node,reassessing the selection based on the updated synchronizationtransmission characteristics, selecting a new one of the synchronizationtrails for passing the synchronization information for use as thesynchronization reference, and sending out updates to neighbouring nodesto indicate the updated synchronization transmission characteristics andthe new trail selection. By covering ongoing reconfiguring, as well asinitial set up, reductions in opex can be maximized.

The synchronization transmission characteristics determined by the trailmanager can comprise information relating to enhancement by any node ofthe synchronization information carried by the packets.

The node can have a portion of a control plane for controlling acommunication network synchronized by the synchronization network, thetrail manager and the comparator being implemented by the portion of thecontrol plane. This can be beneficial since such control planeinfrastructure already exists and has visibility of topology and ofchanges that can affect the configuration of the synchronizationnetwork.

Some of the embodiments described can lead to a significant OPEXreduction in the deployment for new generation hybrid synchronizationnetworks. This can be achieved via the definition of a new powerfulmechanism integrated in the control plane able to handle various typesof synchronization networks (both during the configuration and duringthe operation of the network).

They can be based on a mix of packet based and physical layer basedmethods and can in some cases provide frequency synchronization or timesynchronization (or both).

Some of the characteristics described in more detail in the followingsection are listed as follows:

-   -   Distributed management of the synchronization network;    -   Extension of the automatic synchronization network handling to a        mixed physical layer/packet based methods;    -   Extension of the automatic synchronization network handling to a        mixed physical layer/packet based methods to support time        synchronization;

Even though the distributed approach will be described first, theinitial set-up of the network could be designed by the operator. Anyreconfiguration during operation could be carried out autonomously, oralternatively, the automation may be also extended to some or all of theinitial set-up of the sync network.

This is similar to what is defined in the above referenced IEEE1588 BestMaster Clock Algorithm in the area of packet based synchronization: asignalling channel (Announce messages) is used to communicate betweenall the IEEE1588 nodes and, for each node, to define its role in thenetwork and, for the slaves, to define their master.

FIG. 1 Example of Automated Synchronization Network

In FIG. 1, the synchronization network 200 comprises nodes, denoted A,B, C, D, E, F, G, H, I, L, M, and N, that are nominally linked togetherin a similar configuration to that of the synchronization network 100depicted in FIG. 14. The synchronization network 200 is a hybrid networkas some parts of the trails use packet-based communication. It is anexample of a network having distributed configuration management, as ithas at each node, the ability to route synchronization link stateinformation throughout the synchronization network 200, so that eachnode in the synchronization network 200 can maintain completeinformation about the dynamic link status of the synchronization network200 at any point in the network. In this exemplary embodiment, thesynchronization network 200 further includes an IntegratedSynchronization Network Management Network 201 that is capable ofmanaging all of the nodes in the synchronization network. Provision of acentralised, integrated Synchronization Network Management Network 201is not essential to all embodiments, since as explained above, thisfunction can alternatively be distributed among the various nodes, whicheach have complete information about the trails of the synchronizationnetwork 200 and their dynamic link status in particular.

In FIG. 1, each node in the Synchronization Management Network isassigned an address (e.g., an IP address) that uniquely identifies thatnode. For purposes of convenience, the reference characters A, B, C, D,E, F, G, H, I, L, M, N, and O that are used herein to denote the nodes,will also be used herein to represent the respective addresses of thosenodes. Each node further has a storage device that stores a table thatdefines the relationship between each node and other physical links inthe Synchronization Network 200. In FIG. 1, this is representedschematically by the several configuration information diagrams 203.Some of the nodes are arranged to use packet based communication forparts of the trails. The links shown as using packet-based communicationin this example are denoted by the following node-pairsEF,FG,GH,HM,MN,OF,FI,IH.

FIGS. 2-3 Distributed Trail Selection

In the embodiments having management of configuration distributed acrossthe nodes, the equipment at each node has an interface that is capableof supporting IP, and all such equipment is connected to an IP network.It is emphasized, however, that the use of IP standards is notessential, and that other telecommunication protocol standards could besubstituted therefor, so long as those other protocols permit thecommunication of information between nodes as described below.

In some embodiments, each node further has a storage device that storesa table that defines the relationship between each node and otherphysical links in the Synchronization Network 100. In FIG. 1, this isrepresented schematically by the several configuration informationdiagrams 203.

FIG. 2 shows a schematic view of an example of a node. This shows a node400 of the communications network. This contains a node 410 of thesynchronization network, and other features not used by thesynchronisation network, such as the synchronous communicationsprocessor 470. This is for processing the synchronous traffic on thetransport links of the communications network following conventionalpractice. It is synchronised by the synchronization reference or clock,CK output by the node 410 of the synchronization network.

This node of the synchronization network has a trail selector 440 forselecting which one of the various synchronization trails leading tothis node, is selected for providing the synchronization information.This synchronization information is used by the synchronizationreference generator 450 in the usual way, to generate the clock. Thetrail selector is controlled by an output of the trail comparator 430.This output effectively governs the configuration of this part of thesynchronization network, by controlling which of the trails is selected.

The trail comparator uses information about the source and about thesynchronization transmission characteristics as stored in a database435. A trail information manager 420 fills and maintains this database,by exchanging information with neighbouring nodes, about trails thatthey are aware of, as indicated by the “trail information coms.” in thefigure. In practice, this trail information about the sources andsynchronization transmission characteristics of the trail can be carriedover the same physical paths as used by the communications network, orused by the synchronization trails themselves, or can use independentpaths. Similarly, the synchronization trails can use the same physicalpaths as the communication network traffic, or have independent paths.The trail information manager and the trail comparator can beimplemented as software modules run by a general purpose processor forexample, or can be implemented by software executed by separatehardware, as desired. The node may have a portion of a control plane 425following conventional practice, spread across all nodes of thecommunication network, for distributed control of the traffic in thecommunications network. This same control plane can be adapted and usedto implement the functions of the trail info manager and the trailcomparator.

FIG. 3, Operational Steps in Configuring Synchronization Trails

First an overview of the operational steps will be described in generalterms. The tables in each node are initialized to reflect the initialstate of the synchronization network. This can be done by any node tonode communications protocol as discussed above. Each node (includingthe Integrated Synchronization Network Management node, if one isincluded in the embodiment) now has a complete picture of trailsindicating how reference clocks are propagated throughout the network.Next, the synchronization network is operated, using well-knowntechniques, to distribute synchronization reference clocks to each nodealong the trails. So long as there are no problems or other changes,this continues indefinitely.

However, whenever a change in status occurs at a node, the table in theaffected node is updated. The node to node protocol is then used topropagate this information to all other nodes in the synchronizationnetwork, including the Integrated Synchronization Network Managementnode, if one is included in the embodiment. As updated information ispropagated throughout the synchronization network, one or more nodes mayrespond with their own changes in status/configuration, thereforerequiring further updates to the tables. Thus, through well-knowniterative techniques, and the node to node protocol, the further updatedinformation can be propagated to all other nodes in the synchronizationnetwork, including the Integrated Synchronization Network Managementnode, if one is included in the embodiment.

Eventually, no further changes are made at any nodes, and each nodeagain has a complete picture of how reference clocks are propagatedthroughout the network. The synchronization network can then again beoperated, using well-known techniques, to distribute synchronizationreference clocks to each node. The above described techniques make itpossible to completely carry out all of the synchronization networkmanagement functions in a unified manner yet distributed across thenodes, or under control of into a single (centralized) node. This isespecially important now that new types of equipment (IP routers inparticular) are starting to need to be controlled by a SynchronizationNetwork Management Network as well.

FIG. 3 shows some of the steps in a method of configuring a node, eitherby a centralised management system, or in a distributed way at eachnode. At step 10, it is determined which trails lead to the node. Atstep 20, information about a source of each trail is determined. At step30, information about synchronization transmission characteristics ofpacket based parts of each trail is determined. The determining of thesynchronization trail information at each node can involve transfer ofinformation between nodes regarding synchronization trails and status,or can involve looking up such information previously stored in thedatabase. Different trails are compared at step 40, using at least therespective synchronization transmission characteristics and the sourceinformation, and optionally other information, to select which trail touse for providing the synchronization reference for the node. Thesesteps can be implemented in hardware or software executed by a generalpurpose processor, as desired. More details of examples of how each ofthese steps of determining and comparing can be implemented, will bedescribed below.

Trail Comparison and Selection Using OSPF Principles

With this trail information, the node (any network element) can definealternative synchronization sources without the risk of creating timingloops and in accordance to the network synchronization plan.Alternatively, as already mentioned, the process could use some moreadvanced mechanisms where the network element chooses the mostconvenient synchronization reference based on some appropriate algorithm(for instance minimizing the length of the trails). An output indicatingwhich trail to select is sent to control a trail selector at the node.In this context, although not illustrated, the selector can of courseinclude an internal trail from an internal sync generator which ofcourse need not pass through any other nodes, or over any links betweennodes, in which case the trail can be represented simply by anindication that the trail is internal. An example of a process for suchselection of trail can use the principles used in the OSPF (OpenShortest Path First) protocol, as shown for example in U.S. Pat. No.6,711,411 B1 “Management of Synchronization Network”—Stefano Ruffini,Mar. 23, 2004. The OSPF can provide a fast reaction in case of changesin network topology and flexibility in rearranging the network based onproper optimization algorithm. Via an extension of the OSPF protocol allnodes in the synchronization network have information on thesynchronization links status of the overall synchronization network.

The basic principles are applicable to the network synchronizationapplication. It is assumed that each node must have assigned a uniqueaddress.

The automated determination of information about the trails of the syncnetwork from other nodes can use principles that are known in connectionwith link state routing protocols such as the Open Shortest Path First(OSPF) data routing protocol. These principles can be advantageouslyapplied in the present invention relating to synchronization networkmanagement because they provide for fast reaction in case of changes innetwork topology, small overhead traffic, and flexibility in rearrangingthe network based on proper optimization algorithms.

This is not to be understood to mean that the conventional link staterouting protocols are necessarily useful for managing synchronizationnetworks-they are not if, for example, they do not provide for theexchange of data pertinent to the synchronization network managementfunctions (e.g., data pertaining to synchronization trails and status).However, the OSPF routing protocol enables all routers in an IP networkto have a complete picture of the IP network for purposes of being ableto route each data packet from its source node to its intendeddestination node, and it will now be described how these concepts areusefully applied to facilitate the management of synchronizationnetworks.

In OSPF, providing all routers with a complete picture of the IP networkis accomplished by having each router send updates of its link state(i.e., information about changes in the status of connected links) toother neighbouring routers in the IP network. In a recursive way, thesame information is spread throughout the network, until each router hasthe information, and can create a complete picture of the IP networkthat can be used in the routing of IP packets.

Messages Used for Inter Node Exchange of Trail Info

In accordance with at least some embodiments of the invention, a similarapproach can be used to provide each node in the Synchronization Networkwith complete information about the link status of all of the othernodes in the Synchronization Network. To do this, the information neededis the active synchronization reference and its status (that is, theidentity of the traceable synchronization source and its quality; andthe identities of the stand-by (back-up) synchronization references andtheir status.

A number of messages are required in order to distribute the informationbetween the nodes. Similarly to what is specified in OSPF the followingtypes of messages are needed:

-   -   (Sync) Hello—to periodically inform the connected nodes of the        sender's synchronization status;    -   (Sync) Database Description—to inform about the active and        stand-by synchronization references and their quality status in        the initialization phase;    -   (Sync) Link State Request—to update the synchronization data,        e.g., after the database description has been received by a node        and its own database is found to be out of date;    -   (Sync) Link State Update—to inform other nodes of changes in the        synchronization status;    -   (Sync) Link State Acknowledgement—to acknowledge the receipt of        a Link State Update.

Note: all these messages are sent to the adjacent nodes. All nodes inthe network, however, recursively receive the information.

If messages are received from nodes that are not neighbours (accordingto the topology information owned by the receiving node), these arediscarded. The list of neighbouring nodes is formed via the (Sync) Hellomessages. At network set up this may also be defined by the networkmanagement node in order to speed up the set up process.

Additional messages are needed for the provisioning and set up of thenetwork, e.g.:

-   -   A command to set up which reference should be accepted as a        candidate synchronization reference;    -   A command to set the priorities for the different references;    -   One or more commands to set up thresholds for supervisions        parameters, if any.

The sequence of steps in managing such a network could be summarized asfollows:

-   -   The nodes are configured from a centralized system with some        basic information (e.g. priorities for masters and in general        the information on sync network topology as defined by the        operator);    -   Tables in each node are updated using the (Sync) Hello and        (Sync) Database Description messaging). This corresponds to        steps 20 and 30 of FIG. 3, mentioned above. Each node (or in        some cases only a centralized node) has a complete picture of        the synchronization network;    -   The network is operated accordingly;    -   When a change occurs at node X, table of this node is updated        (again corresponding to steps 20 and 30), the selection of the        trail for that node may be reassessed (corresponding to step 40        of FIG. 3), and the new information is propagated to all other        nodes in the network (including the centralized node) via the        (Sync) Link State Update messaging;    -   As information is propagated throughout the network, one or more        nodes may respond with their own changes, thus further requiring        changes in table of node X. The iterative process will        eventually result in a new status of the synchronization        network.

A further example having some similar steps is shown in FIG. 5 describedbelow. In the case of a fully automated network, the initialconfiguration can include only basic data (such as the name and locationof the master(s)) and other constraints defined by the operator. Thetrail selection (also called synchronization reference selection)performed by each node can be carried out according to some iterativeprocess (similar to the case of recovery after failures in the network)and based on some appropriate rules and algorithms.

FIG. 4, Packet Format and State Tables

An example of database information owned at a certain point in time byeach node is shown in FIG. 4. This full table can be forwarded in the(Sync) Database Description messages to the adjacent nodes. The (Sync)Link State Update would usually only include the portion of the tablethat is requested in the (Sync) Link State Request (e.g. the rows thatconcern a specific node). The (Sync) Hello packets can includeinformation on the sender status only (e.g. status of the connected synclinks).

The table has a number of rows for each of the nodes shown in FIG. 1 inthis example, each row corresponding to a different trail leading toeach node, or to an internal trail for that node. In a first column 301of the table, each of the nodes in the Synchronization Network 200 isdefined. For each of these nodes, an entry in a second column 303 of thetable identifies the node's source of synchronization. For example, nodeA is a PRC (refer to FIG. 1 or 14), and thus has no other source. Node Bhas a link to receive synchronization from node A, and this is indicatedin the second column 303. Moreover, for node B this is the preferredsource of synchronization, so in a third column 305 of the table, thereis an indication that this source is to be given highest priority (e.g.,priority “1”).

Many nodes have more than one possible source of synchronization. Forexample, node B has a link to receive synchronization from node A, asindicated above, but also has an internal clock that it canalternatively use as a synchronization reference. Each of these isassigned a relative priority that indicates an order of preference ofuse of these possible synchronization sources. So, for example, node B'shighest priority synchronization reference is received from node A, andits next highest priority synchronization reference (in this case,priority “2”) comes from node B's own internal clock.

A fourth column 307 in the table indicates the succession of nodesthrough which the synchronization reference can be traced. For example,node A is a PRC, so there are no nodes through which its synchronizationreference is derived. For node B, the synchronization reference istraceable to node A when the highest priority reference (i.e., the oneprovided by node A) is used, and alternatively traceable to B itselfwhen B's own internal clock is used. The parenthesis is used in thefourth column to indicate when a Node is part of the sync over packetchain but is only forwarding the timing packets, not processing them orenhancing them.

A fifth column 309 indicates for the network element, the status of thecorresponding synchronization reference. Possible states include:“Network PRC (G.811)”; “locked (G.811)”; “stand-by (G.812)”; and“stand-by (G.813)”, the latter being a lower quality clock than thatdefined by G.812. These states are well-known in the art, and aredefined, for example, in ITU-T recommendation G.811 (2/97), “Timingcharacteristics of Primary Reference Clocks”; and ITU-T recommendationG.812 (2/97), “Timing characteristics of Slave Clocks”; and ITU-Trecommendation G.813 (8/96), “Timing characteristics of SDH EquipmentSlave-Clocks (SEC)”, all of which are hereby incorporated herein byreference in their entireties.

A sixth column 311 indicates whether the trail has a packet-based part,or whether it is carried by synchronous links. A seventh column 313 inthe table indicates a Supervision Result, such as: Maximum Time IntervalError (MTIE), Time Deviation (TDEV), Frequency Deviation (FDEV), and thelike. In case of a packet based link, this could be a PDV measurement.PDV measurements are under consideration as part of standard G.8261.These Supervision Results are the result of usually periodicalsupervision, and are set by the routine in the network elementperforming the supervision tests. These results may be read by theoperator to check the quality of a synchronization network, but may alsobe used by the synchronization network in an automatic manner in orderto reconfigure the synchronization network (e.g., in case a linkexhibits poor quality). The Supervision Results MTIE and TDEV are wellknown in the art, and are defined in ITU-T recommendation G.810 (5/96),“Definitions and terminology for synchronization networks”, and so neednot be described here in more detail. The Supervision Result SSM is alsowell known and is defined in the above-referenced ETSI document EG 201783. Frequency Deviation is also a well-known concept, and need not bedefined here. An eighth column 315 indicates node functions, of nodesalong the trail which might affect the synchronization transmissioncharacteristics. This enables the table to include some synchronizationtransmission characteristics of parts of the trails using packet-basedcommunications.

FIG. 4, Synchronization Transmission Characteristics for thePacket-based Part

The main difference between physical layer based communication andpacket based communication (for example, timing carried via IEEE1588(PTP) packets) is that in the former case the synchronization isdistributed and regenerated by all network elements that are part of thesynchronization network. In the latter case the timing is distributedfrom a master to a slave, and the intermediate nodes may or may not berequired to handle the timing (e.g. via regeneration). Anotherfundamental difference is that from a slave perspective the stand-byreference can be defined on a master clock basis and not on a link basisas in case of the traditional physical layer synchronization methods.

This means that different information needs to be exchanged between thenodes, for the packet-based parts of the trails, and the trailcomparison step needs to be able to take account of this newinformation. In some embodiments, a single unified management protocolrunning over the control plane can handle at the same time differenttypes of synchronization networks (e.g. SyncE and IEEE1588), though inprinciple, the different types of information for the packet-based andsynchronous parts could be gathered by different protocols, optionallystored in different places, and both places accessed by the trailcomparator to enable the different types to be compared.

The following cases of packet-based communication can be identified:

-   -   Full packet based network running over a connection-oriented        packet network;    -   Full packet based network running over a connection-less packet        network;    -   Mixed physical layer/packet based network

The packet based method can also be deployed with or without timingsupport of the network (e.g. timing packets regenerated or modified inall or some of the network nodes along a trail).

The connection-less scenario will not be discussed in detail, becausedelays are less predictable. Some QoS mechanism over pre-defined pathscan be used to make the delays more predictable. The nodes that are partof the packet-based parts of the synchronization network could be of thefollowing types for example (other types may be envisaged):

-   -   Nodes only forwarding the timing packet (and therefore adding        some packet jitter);    -   Nodes regenerating the time (e.g. IEEE1588 Boundary Clock); this        is very similar to a physical layer based clock (e.g. in terms        of stand-by references, clock quality etc.), see FIG. 4, first        trail leading to F;    -   Nodes which enhance the packet data (e.g. IEEE1588 Transparent        Clock nodes), to enhance the data to indicate delay values        detected at the node, see for example FIG. 4, trail leading to        H; and    -   Nodes defined by the routing protocol as an alternative path in        case of failures in the network (in this case, some interaction        with the routing protocol data (e.g. OSPF LSA) could be used in        order to get a picture of the available routing paths.

These different types of nodes can affect the timing of thesynchronization information being carried by the packets, and soinformation about these nodes can represent synchronization transmissioncharacteristics of the trails. The trail comparison and selectionmechanism in this context can be extended to take into account forexample transmission characteristics such as number of nodes in thetrail, number of nodes that are not providing timing support, number ofBoundary Clock nodes, number of transparent clock nodes and so on.

In case of a mixed physical layer/packet based methods, this informationcan also be added by each node. The comparison and selection mechanismcan also consider other factors such as the reliability of one methodvs. the other (in particular a physical layer based method is notimpacted by packet delay variation and could be considered as a firstpriority).

The data exchanged between the nodes and with the management network,can therefore include the above information.

In order to avoid excessively large tables, the synchronization networkcan optionally be divided up into parts, with each part containing onlydata for a related subset of the entire synchronization network.

FIG. 5, Steps Using the Synchronization Transmission Characteristics

FIG. 5 shows a flow chart of steps involved in configuring thesynchronization network according to an embodiment. At step 200, a nodeis added to the hybrid synchronization network. Step 210 involvesstarting configuration of the node by communicating with other nodes toexchange information to determine trails leading to the node. This caninvolve for example obtaining a copy of the table of FIG. 4 from othernodes, or filling in the rows of such a table by requesting informationfrom other nodes. At step 220 source information is determined for eachtrail, and at step 230 synchronization transmission characteristics aredetermined. This can involve for example obtaining from the other nodes,or from a central location, information to fill in columns two and eightof the table of FIG. 4, for the rows corresponding to the node inquestion. Other ways of obtaining or storing such information can beenvisaged.

At step 240, the trails leading to the node are compared, using thesource information and the synchronization characteristics, to selectwhich trail to use. Some ways of implementing this step are described inmore detail below with reference to FIGS. 6 to 9. Optionally the newselection is recorded, optionally in the priority column of the table,and if second and third priority levels and so on are determined for theremaining trails, these priorities can also be recorded. This can enablethe node to switch to a back up trail instantly if needed, without afull reassessment of the priorities.

Step 250 shows normal operation of the synchronization network toprovide a synchronization reference for the corresponding node of thecommunications network as shown in FIG. 2 for example, based onsynchronization information passed from a remote synchronization sourceover the selected trail. At step 260, the trail information isperiodically updated, perhaps as a result of a fault or alarm condition,or reconfiguration of any part of the communications network. This canbe by exchange of information between nodes, as described in more detailbelow.

Updating the Database Table Avoiding Timing Loops

The discussion will now focus on how the contents of the table aremodified in the event of a failure in the synchronization network.Suppose that a malfunction (e.g., a break in a cable) occurs thatrenders the synchronization link between nodes F and G inoperative. Thismeans that node G will have to obtain synchronization from anothersource, and in order to avoid timing loops, other nodes may need to bereconfigured as well. This can be coordinated by utilizing a protocol todistribute table updates, so that each node (including the oneassociated with the Integrated Synchronization Network Managementnetwork 201) will have complete information upon which to basereconfiguration decisions. The information changes piece-wise, so anumber of updated tables are created and distributed in succession.

For example, after detecting the loss of its synchronization source,node G would examine its own table and discover that it cannotimmediately select to receive its synchronization reference from node H,since this would cause a timing loop. (The table shows that the node H'ssource is traceable to node G.) So, node G opts instead to receive itssynchronization reference from its own internal clock. Node G updatesthe table 300 to reflect this change, and distributes it to the othernodes in the synchronization network. As the table is distributed fromnode to node, changes are made in a piecemeal fashion to adjust to theprevious changes. In particular, if a Supervision Result indicating“ALARM” has been generated in Node G for example as a result of thesupervisor detecting something not working, such as Loss of Frame, orMTIE exceeding a certain threshold, then this “ALARM” in turn causesNode G's highest priority link to transition from a “locked” state to a“FAILURE” state. In response to this failure, Node G's third prioritysynchronization reference source now transitions from a “standby” modeto a “locked” state (meaning that it is being used by node G). Thishighlights the fact that in the reference selection algorithm, thecondition of avoiding timing loops is given greater importance thanchoosing the reference having the highest priority. A furtherconsequence is that node H will change to show a transition in qualityfrom a G.811 quality reference to a G.813 quality reference.

FIGS. 6-8, Comparing Trails

FIG. 6 shows some steps involved in one possible implementation of step240 of FIG. 5. As shown, a first step, 310 is determining which nodesare on the parts of trails using packet-based communication. At step 320a check is made that each of the trail routes does not use the same nodetwice, to avoid timing loops. At step 330, a number of nodes in each ofthe trails is determined and used as a measure of transmission quality.This can involve for example using column 4 of FIG. 4, to determinewhich nodes are passed, and using column eight of FIG. 4 to determinewhich of those nodes are in the packet-based part of the trail.

At step 340, the trails are compared to determine if one trail hassignificantly fewer nodes. A threshold can be applied, depending on howmany trails are being compared for example, or depending on the lengthsof the trails. If the shortest trail has say less than 10 nodes, it willbe selected, otherwise if the shortest trail has 20% fewer nodes thanthe second shortest trail, then it can be selected. Many other similaralgorithms can be envisaged. The comparison can include the sourcecharacteristics as a factor, if the sources have different qualities,such as jitter, or reliability If no trail is clearly optimal, then atstep 350, further synchronization transmission characteristics can bedetermined for use in the comparison.

FIG. 7 shows at step 352 determining a speed of links between nodes.This is not shown directly in the table of FIG. 4, but can be determinedin various ways, by a request to either a central database or a localstore in the node indicating the network topology and details of thedata rates of links between nodes. The request can identify the linksbased on which nodes are involved. As in step 330, which nodes arepassed can be obtained for example by using column 4 of FIG. 4, todetermine which nodes are passed, and using column eight of FIG. 4 todetermine which of those nodes are in the packet-based part of thetrail.

At step 354, delays and or jitter can be determined and accumulated foreach of the trails, based on the information about the speed of thelinks. At step 356, the trails can be compared based on theiraccumulated totals, to see if one trail is significantly better than theothers. Again suitable thresholds can be used as discussed above, todetermine by what degree or amount a trail must exceed its rivals to beselected. At step 358 a selected trail is output, or if the best traildoes not meet the threshold, then further characteristics aredetermined.

For example, at step 362, it is determined how many nodes in each trailact to enhance the synchronization information. This can be based on thenode function information in the eighth column of FIG. 4, describedabove, to see if there are any nodes which enhance for example bymeasuring actual jitter or delays along the trail, to enablecompensation or at least enable assumptions of these values to bereplaced by actual values. At step 364 again trails are compared to seeif one trail is significantly better than the others. Again suitablethresholds can be selected. If the best trail meets the thresholds, itis selected and a suitable output made to the trail selector, otherwisemore characteristics can be determined at step 366.

FIG. 8 shows at step 372 determining any nodes which regenerate thesynchronization information, such as boundary clock nodes. Again thiscan be based on the node function information in the eighth column ofFIG. 4, described above. At step 374 again trails are compared to see ifone trail is significantly better than the others. Again suitablethresholds can be selected. If the best trail meets the thresholds, itis selected and a suitable output made to the trail selector, otherwisemore characteristics can be determined at step 376. Such othercharacteristics could be other transmission characteristics such asreliability, or other factors.

FIG. 9, Comparison Involving Combining Synchronous and Packet-basedParts

FIG. 9 shows a similar series of steps to those of FIG. 6, but with theadditional step of combining synchronous and packet-based parts. As inFIG. 6, it shows some steps involved in one possible implementation ofstep 240 of FIG. 5. As shown, a first step, 310 is determining whichnodes are on the parts of trails using packet-based communication. Atstep 320 a check is made that each of the trail routes does not use thesame node twice, to avoid timing loops. At step 330, a number of nodesin each of the trails is determined and used as a measure oftransmission quality. This can involve for example using column 4 ofFIG. 4, to determine which nodes are passed, and using column eight ofFIG. 4 to determine which of those nodes are in the packet-based part ofthe trail. At step 335, delays (or other characteristics such as jitter)of packet-based parts of each trail are combined with accumulated delaysof any synchronous parts. This can be based on numbers of nodes or othermeasures of delays or jitter.

At step 345, the trails are compared to determine if one trail hassignificantly better transmission quality (such as fewer nodes). Athreshold can be applied, depending on how many trails are beingcompared for example, or depending on the lengths of the trails. If theshortest trail has say less than 10 nodes, it will be selected,otherwise if the shortest trail has 20% fewer nodes than the secondshortest trail, then it can be selected. Many other similar algorithmscan be envisaged. If no trail is clearly optimal, then at step 350,further synchronization transmission characteristics can be determinedfor use in the comparison.

FIG. 10, Centralised Trail Comparison

FIG. 10 shows an example showing similar features to those of FIG. 2,but differing in that the functions relating to configuration, such astrail comparison, are carried out centrally. The figure shows acentralised synchronization network management system 500, having atrail info manager 420, a trail info database 435, and a trailcomparator 430.

There is a node 410 of a synchronization network, which outputs asynchronization reference or clock, for use by synchronous parts of acommunications network. This node of the synchronization network has atrail selector 440 for selecting which one of the varioussynchronization trails leading to this node, is selected for providingthe synchronization information. As in FIG. 2, this synchronizationinformation is used by the synchronization reference generator 450 inthe usual way, to generate the clock. The trail selector is controlledby an output of the trail comparator 430 from the centralizedsynchronization network management system.

The trail comparator uses information about the source and about thesynchronization transmission characteristics as stored in the database435. The trail information manager 420 fills and maintains thisdatabase, by obtaining information from all the nodes in thesynchronization network. An advantage of centralising these functions,compared to having them distributed across all the nodes, is that delaysin propagating information across large networks can be reduced. Also,it is easier for operators to intervene in the centralised version.Conceivably the trail info database could be held centrally, and thetrail comparator algorithm carried out locally at each node. This wouldspread the computational resource demands, but increase thecommunications requirements between the nodes and the centraliseddatabase.

FIG. 11, Example of Choice of Trails in a Mixed Physical Layer/PacketSync Environment

FIG. 11 shows a hybrid synchronization network similar to that of FIG. 1(but not identical, for example node G is a transparent clock node inFIG. 11). In FIG. 11, two trails are shown leading to node N. A firsttrail highlighted by a dashed line passes from O via F, I, H and M. Asecond trail highlighted by a solid line passes from E via F, G, H andM. Both trails have the same number of nodes, and so cannot bedistinguished on that criteria alone, as per the steps shown in FIG. 6.Nevertheless, the trails can be distinguished using step 362 of FIG. 7.The second trail offers better timing support because it passes node Gwhich is a transparent clock node, rather than node I which does notprocess the packets at all. This would be apparent in the last column ofthe table of FIG. 4, if FIG. 4 were amended to correspond to the networkof FIG. 11.

Extension to Time-Phase Synchronization

The time (and/or phase) synchronization application typically implies asynchronization network using a packet based method. In some cases asolution could be designed where the packet based method get supportfrom an underlying physical layer method that is used to distributefrequency synchronization (this is sometimes referred to as“On-Path-Support”, OPS).

In addition to the need for a time (or phase) reference, the maindifference between a packet based method which is used to distributefrequency from a method that also distribute time, is related to a needfor a two-way protocol. That is the timing packets are sent from masterto slave and from slave to master. Another characteristic is that inorder to deliver accurate time, support from the network nodes (e.g.IEEE1588 Boundary Clocks) would be required in many significant networkscenarios.

Assuming that the two-way protocol is deployed with the downlink timingflow distributed over the same nodes as the related uplink flow, theextension of the discussions presented in earlier sections isstraightforward.

In case of a time synchronization network getting support from aphysical layer synchronization method the additional information on OPSavailability is considered. In this case the node has to maintain inparallel two sync Databases: one for frequency synchronizationdistribution and the second one for time synchronization distribution.

The distributed approach is preferred as it can guarantee the highestperformances in terms of convergence time.

FIGS. 12,13, Extension of Existing Control Plane Protocols

As part of some embodiments, the OSPF is extended in a similar way asdone for Optical Network control plane (e.g., ASON/WSON). In case ofASON the OSPF has been extended into the G.OSPF-TE (Generalized. OSPFwith Traffic Engineering extensions) in order to collect/disseminatetechnology specific information such as wavelength continuity, physicalimpairments and so forth.

In this example OSPF is extended via the definition of a TE Link LSA(Link State Advertisement) capable of carrying also synchronizationinformation. In particular, for the synchronization applicationsdiscussed here, the G.OSPF-TE is adapted to distribute thesynchronization network topology information. Note that no signallingprotocol extension is required as the information distributed via theextended OSPF is sufficient for the nodes to properly set up thesynchronization paths.

Each TE Link in the network is described by the OSPF with a TE Link LSA(as specified in RFC 3630—Traffic Engineering (TE) Extensions to OSPFVersion 2) containing a Link TLV (Type Length Value). A TE Link LSAcomprises a certain number of sub-objects called sub-TLVs. Each of thesesub-objects describes some of the characteristics of the TE Link.

Each TE Link contains one or more Link Components (LC) representing aphysical connection between two adjacent nodes. The first parameterassociated with a LC is a local identifier that can univocally identifyit: the Link Component ID. Other parameters are technology specific and,in this specific context, are related to synchronization.

FIG. 12 provides an example of a sync-specification Sub-TLV whichcomprises two Link Components and the synchronization parametersassociated to them. As shown by (*) in the top row, this value of 1assumes that this is the only sync extension. In the second row, theindication (**) next to the Sub-Sub-Type value is to note that otherscan be added for other synchronization methods (e.g., packet-based, SDH,etc), and the parameters set will change accordingly.

An additional set of synchronization parameters (e.g., clock quality andstate) is associated to the node. These parameters can be disseminatedvia a specific sub-TLV in the TE Link LSA as shown in the example ofFIG. 13.

FIG. 13 shows an example of synchronization specific sub-TLV (node case)in which Again in the first row, the indication (*) is there to note theassumption that this is the only sync extension. In the second row, theindication (**) is there to note the assumption that this is the onlynode type. Alternatively other Sub-Sub-Types (with increasing id, i.e.,3, 4, etc.) can be added for other node types, and the parameters setwill change accordingly. In the fourth row, the indication (***) is tonote that this node function can correspond to the content of the eighthcolumn of FIG. 4, E.g., Network PRC, G.8263 TC, etc.

The second parameter, in the sixth row is supervision status in thisexample, which corresponds to the content of the seventh column of FIG.4. Hence it can be seen how this can be used to exchange informationbetween nodes to fill in the table of FIG. 4, which can then be used asa basis for various trail comparison algorithms, to select a bestsynchronisation trail for each node, and thus configure thesynchronization network.

In addition to OSPF, other existing or new protocols could be consideredas long as they provide additional functionalities. For example, the LMP(Link Management Protocol), which runs between a pair of nodes and isaimed at TE Links management, could be used to enhance thesynchronization solution.

Other Features

The new protocol adapted to convey the new transmission characteristicscan be arranged to coexist with existing synchronization mechanisms.Where any conflict arises, there may be a need to have nodes ignore someparts, such as the “SSM” protocol, which might need to be ignored inorder to avoid possible misalignments.

For the case of the physical layer based synchronization networks (e.g.SyncE, SDH), all the protocol packets described above travel a single IPhop. That means that all network elements that participate into thesynchronization network (or that terminate it) have to be properlyaddressed (the protocol shall operate on link basis). In other words thepackets shall not be carried transparently over network elements thatare part of the synchronization network.

Other variations and embodiments can be envisaged within the claims.

The invention claimed is:
 1. A method of configuring a node of asynchronization network, the method comprising: receiving communicationsfrom a plurality of nodes in the synchronization network; based on thecommunications from the plurality of nodes, determining synchronizationsource information for a plurality of active synchronization trailspassing synchronization information from a plurality of synchronizationsources to the node to provide a synchronization reference; determiningthat at least one active synchronization trail comprises a first partthat uses packet-based communication to pass the synchronizationinformation and a second part that uses synchronous links to passsynchronization information; determining at least one node in theplurality of nodes that is on the first part of the at least one activesynchronization trail that uses the packet-based communication to passthe synchronization information; communicating with the at least onenode to determine synchronization transmission characteristics of thefirst part of the at least one active synchronization trail usingpacket-based communication, wherein the synchronization transmissioncharacteristics indicate a measure of transmission quality; using thesynchronization source information about the synchronization sources andthe synchronization transmission characteristics of the first part ofthe at least one active synchronization trail to perform a comparison ofthe plurality of synchronization trails; and based on the comparison ofthe plurality of synchronization trails leading to the node, selectingat least one of the plurality of active synchronization trails to usefor providing the synchronization reference for the node.
 2. The methodof claim 1, wherein determining the synchronization transmissioncharacteristics comprises determining information about nodes usingpacket-based communication.
 3. The method of claim 2, whereindetermining the synchronization source information comprises determininginformation relating to enhancement by any node of the synchronizationinformation carried by a plurality of packets.
 4. The method of claim 3,wherein determining the information relating to enhancement comprisesdetermining information relating to regeneration of the synchronizationinformation at another node along the trail.
 5. The method of claim 3,wherein: the enhancement comprises information about delays, asdetermined by another node along the trail, to the plurality of packetscarrying the synchronization information; and the information aboutdelays comprises any one or more of: delays internal to a node, delaysbetween a plurality of nodes, and amounts of delay variation.
 6. Themethod of claim 1, wherein the synchronization transmissioncharacteristics comprise jitter.
 7. The method of claim 1, furthercomprising: determining information about synchronous parts of anytrails leading to the node; and using the information about thesynchronous parts while performing the comparison of the plurality ofsynchronization trails.
 8. The method of claim 1, wherein the step ofdetermining the synchronization transmission characteristics isperformed by the node, and the node maintaining a record of thesynchronization trails to the node and to other nodes.
 9. The method ofclaim 1, further comprising: receiving, at the node, an update of thesynchronization transmission characteristics; based on the updatedsynchronization transmission characteristics, performing a newcomparison of the plurality of synchronization trails; selecting a newone of the plurality of synchronization trails for passing thesynchronization information for use as the synchronization reference;and sending out an update to at least one neighboring node to indicatethe updated synchronization transmission characteristics and the new oneof the plurality of synchronization trails selected for passingsynchronization information.
 10. A node for a synchronization network,the node comprising: a memory; and one or more processors coupled to thememory, the one or more processors operable to: receive communicationsfrom a plurality of nodes in the synchronization network; based on thecommunications from the plurality of nodes, determine synchronizationsource information for a plurality of active synchronization trailspassing synchronization information from a plurality of synchronizationsources to the node to provide a synchronization reference; determinethat at least one active synchronization trail comprises a first partthat uses packet-based communication to pass the synchronizationinformation and a second part that uses synchronous links to passsynchronization information; determine at least one node in theplurality of nodes that is on the first part of the at least one activesynchronization trail that uses the packet-based communication to passthe synchronization information; communicate with the at least one nodeto determine synchronization transmission characteristics of the firstpart of the at least one active synchronization trail using packet-basedcommunication, wherein the synchronization transmission characteristicsindicate a measure of transmission quality; use the synchronizationsource information about the synchronization sources and thesynchronization transmission characteristics of the first part of the atleast one active synchronization trail to perform a comparison of theplurality of synchronization trails; and based on the comparison of theplurality of synchronization trails leading to the node, select at leastone of the plurality of active synchronization trails to use forproviding the synchronization reference for the node.
 11. The node ofclaim 10, wherein the synchronization transmission characteristicscomprise information relating to enhancement by any node of thesynchronization information carried by a plurality of packets.
 12. Thenode of claim 11, wherein the information relating to enhancementcomprises information relating to regeneration of the synchronizationinformation at another node along the trail.
 13. The method of claim 11,wherein: the information relating to enhancement comprises information,as determined by another node along the trail, about delays to theplurality of packets carrying the synchronization information; and theinformation about delays comprising any one or more of: delays internalto a node, delays between a plurality of nodes, and amounts of delayvariation.
 14. The method of claim 10, wherein the synchronizationtransmission characteristics comprise jitter.
 15. The node of claim 10,further comprising a portion of a control plane for controlling acommunication network synchronized by the synchronization network, theone or more processors being implemented by the portion of the controlplane.
 16. The node of claim 10, wherein the one or more processors arefurther operable to: receive an update of the synchronizationtransmission characteristics; based on the updated synchronizationtransmission characteristics, perform a new comparison of the pluralityof synchronization trails; select a new one of the plurality ofsynchronization trails for passing the synchronization information foruse as the synchronization reference; and send out an update to at leastone neighboring node to indicate the updated synchronizationtransmission characteristics and the new one of the plurality ofsynchronization trails selected for passing synchronization information.17. A management system for a synchronization network, the managementsystem being arranged to carry out the method of configuring as set outin claim
 1. 18. A synchronization network having a number of nodes, andhaving a number of synchronization trails for passing synchronizationinformation from a synchronization source to the nodes of the hybridsynchronization network, the hybrid synchronization network having amanagement system arranged to carry out the method of configuring as setout in claim
 1. 19. A non-transitory computer readable medium storinginstructions executable by a processor to cause the processor to:receive communications from a plurality of nodes in the synchronizationnetwork; based on the communications from the plurality of nodes,determine synchronization source information for a plurality of activesynchronization trails passing synchronization information from aplurality of synchronization sources to the node to provide asynchronization reference; determine that at least one activesynchronization trail comprises a first part that uses packet-basedcommunication to pass the synchronization information and a second partthat uses synchronous links to pass synchronization information;determine at least one node in the plurality of nodes that is on thefirst part of the at least one active synchronization trail that usesthe packet-based communication to pass the synchronization information;communicating with the at least one node to determine synchronizationtransmission characteristics of the first part of the at least oneactive synchronization trail using packet-based communication, whereinthe synchronization transmission characteristics indicate a measure oftransmission quality; use the synchronization source information aboutthe synchronization sources and the synchronization transmissioncharacteristics of the first part of the at least one activesynchronization trail to perform a comparison of the plurality ofsynchronization trails; and based on the comparison of the plurality ofsynchronization trails leading to the node, select at least one of theplurality of active synchronization trails to use for providing thesynchronization reference for the node.
 20. The non-transitory computerreadable medium of claim 19, wherein the instructions are executable bythe processor to further cause the processor to: receive an update ofthe synchronization transmission characteristics; based on the updatedsynchronization transmission characteristics, perform a new comparisonof the plurality of synchronization trails; select a new one of theplurality of synchronization trails for passing the synchronizationinformation for use as the synchronization reference; and send out anupdate to at least one neighboring node to indicate the updatedsynchronization transmission characteristics and the new one of theplurality of synchronization trails selected for passing synchronizationinformation.